Benchmark Hive Router Query Planner in Hive Gateway #841

enisdenjo · 2025-10-26T18:57:16Z

Ref GW-510
Closes #862
Related graphql-hive/gateway#1629

Also

Updated Hive Router and Grafbase versions to latest
No JIT on Hive Gateway with Bun

github-actions · 2025-10-26T18:58:33Z

💻 Website Preview

The latest changes are available as preview in: https://ae7575c2.federation-gateway-benchmark.pages.dev

github-actions · 2025-10-26T19:03:08Z

Overview for: `constant-vus-over-time`

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Gateway	RPS ⬇️	Requests	Duration	Notes
hive-router	1679	101182 total, 0 failed	avg: 29ms, p95: 50ms	✅
grafbase	1618	97732 total, 0 failed	avg: 30ms, p95: 53ms	✅
cosmo	693	41904 total, 0 failed	avg: 71ms, p95: 105ms	✅
hive-gateway-router-runtime	626	38023 total, 0 failed	avg: 79ms, p95: 103ms	✅
apollo-router	376	22907 total, 0 failed	avg: 131ms, p95: 170ms	✅
hive-gateway	305	18643 total, 0 failed	avg: 161ms, p95: 291ms	✅
apollo-gateway	120	7368 total, 0 failed	avg: 408ms, p95: 481ms	✅

Summary for: hive-router

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 303246      ✗ 0     
     data_received..................: 8.9 GB  147 MB/s
     data_sent......................: 118 MB  2.0 MB/s
     http_req_blocked...............: avg=6.52µs   min=973ns   med=2.53µs  max=20.7ms   p(90)=4µs      p(95)=4.92µs   p(99.9)=90.28µs
     http_req_connecting............: avg=3.48µs   min=0s      med=0s      max=20.67ms  p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_duration..............: avg=29.42ms  min=1.91ms  med=27.22ms max=432.83ms p(90)=44.14ms  p(95)=50.23ms  p(99.9)=86.74ms
       { expected_response:true }...: avg=29.42ms  min=1.91ms  med=27.22ms max=432.83ms p(90)=44.14ms  p(95)=50.23ms  p(99.9)=86.74ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 101182
     http_req_receiving.............: avg=106.86µs min=23.89µs med=44.75µs max=54.14ms  p(90)=103.38µs p(95)=334.31µs p(99.9)=7.93ms 
     http_req_sending...............: avg=95.08µs  min=4.24µs  med=9.72µs  max=370.7ms  p(90)=23.69µs  p(95)=125.95µs p(99.9)=12.71ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=29.22ms  min=1.86ms  med=27.06ms max=419.4ms  p(90)=43.83ms  p(95)=49.92ms  p(99.9)=84.94ms
     http_reqs......................: 101182  1679.005245/s
     iteration_duration.............: avg=29.67ms  min=5.1ms   med=27.43ms max=458.52ms p(90)=44.36ms  p(95)=50.44ms  p(99.9)=87.28ms
     iterations.....................: 101082  1677.345853/s
     success_rate...................: 100.00% ✓ 101082      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50

Performance Overview

HTTP Overview

Summary for: grafbase

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 292896      ✗ 0    
     data_received..................: 8.6 GB  142 MB/s
     data_sent......................: 114 MB  1.9 MB/s
     http_req_blocked...............: avg=6.04µs   min=1.18µs  med=2.88µs  max=9.76ms   p(90)=3.98µs   p(95)=4.64µs   p(99.9)=111.59µs
     http_req_connecting............: avg=2.57µs   min=0s      med=0s      max=9.72ms   p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_duration..............: avg=30.4ms   min=2.85ms  med=27.19ms max=507.08ms p(90)=46.63ms  p(95)=53.31ms  p(99.9)=98.61ms 
       { expected_response:true }...: avg=30.4ms   min=2.85ms  med=27.19ms max=507.08ms p(90)=46.63ms  p(95)=53.31ms  p(99.9)=98.61ms 
     http_req_failed................: 0.00%   ✓ 0           ✗ 97732
     http_req_receiving.............: avg=149.75µs min=23.75µs med=45.84µs max=72.09ms  p(90)=129.98µs p(95)=373.61µs p(99.9)=18.55ms 
     http_req_sending...............: avg=113.33µs min=5.3µs   med=11.36µs max=298.76ms p(90)=36.16µs  p(95)=132.26µs p(99.9)=16.82ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=30.14ms  min=2.8ms   med=27.01ms max=490.02ms p(90)=46.16ms  p(95)=52.76ms  p(99.9)=96.86ms 
     http_reqs......................: 97732   1618.686287/s
     iteration_duration.............: avg=30.71ms  min=6.95ms  med=27.48ms max=534.61ms p(90)=46.93ms  p(95)=53.6ms   p(99.9)=101.13ms
     iterations.....................: 97632   1617.030037/s
     success_rate...................: 100.00% ✓ 97632       ✗ 0    
     vus............................: 50      min=50        max=50 
     vus_max........................: 50      min=50        max=50

Performance Overview

HTTP Overview

Summary for: cosmo

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 125412     ✗ 0    
     data_received..................: 3.7 GB  61 MB/s
     data_sent......................: 49 MB   807 kB/s
     http_req_blocked...............: avg=16.11µs  min=1.34µs med=2.87µs  max=16.02ms  p(90)=3.91µs   p(95)=4.52µs   p(99.9)=6.3ms   
     http_req_connecting............: avg=12.56µs  min=0s     med=0s      max=15.99ms  p(90)=0s       p(95)=0s       p(99.9)=6.28ms  
     http_req_duration..............: avg=71.29ms  min=2.82ms med=70.19ms max=482.77ms p(90)=96.59ms  p(95)=104.52ms p(99.9)=269.87ms
       { expected_response:true }...: avg=71.29ms  min=2.82ms med=70.19ms max=482.77ms p(90)=96.59ms  p(95)=104.52ms p(99.9)=269.87ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 41904
     http_req_receiving.............: avg=161.17µs min=30.8µs med=68.01µs max=38.93ms  p(90)=143.37µs p(95)=387.24µs p(99.9)=15.18ms 
     http_req_sending...............: avg=66.18µs  min=5.59µs med=11.35µs max=347.81ms p(90)=30.56µs  p(95)=126.79µs p(99.9)=5.49ms  
     http_req_tls_handshaking.......: avg=0s       min=0s     med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=71.06ms  min=2.71ms med=69.99ms max=482.51ms p(90)=96.29ms  p(95)=104.26ms p(99.9)=257.82ms
     http_reqs......................: 41904   693.691244/s
     iteration_duration.............: avg=71.78ms  min=7.94ms med=70.51ms max=531.33ms p(90)=96.89ms  p(95)=104.85ms p(99.9)=298.47ms
     iterations.....................: 41804   692.035814/s
     success_rate...................: 100.00% ✓ 41804      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50

Performance Overview

HTTP Overview

Summary for: hive-gateway-router-runtime

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 113769     ✗ 0    
     data_received..................: 3.3 GB  55 MB/s
     data_sent......................: 44 MB   729 kB/s
     http_req_blocked...............: avg=10.31µs  min=1.23µs  med=2.76µs  max=10.22ms  p(90)=4.56µs   p(95)=5.69µs   p(99.9)=2.1ms   
     http_req_connecting............: avg=6.7µs    min=0s      med=0s      max=10.18ms  p(90)=0s       p(95)=0s       p(99.9)=2.07ms  
     http_req_duration..............: avg=78.58ms  min=4.98ms  med=76.31ms max=577.94ms p(90)=95.1ms   p(95)=102.91ms p(99.9)=341.36ms
       { expected_response:true }...: avg=78.58ms  min=4.98ms  med=76.31ms max=577.94ms p(90)=95.1ms   p(95)=102.91ms p(99.9)=341.36ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 38023
     http_req_receiving.............: avg=105.92µs min=25.51µs med=50.3µs  max=140.38ms p(90)=114.92µs p(95)=319.27µs p(99.9)=4.82ms  
     http_req_sending...............: avg=100.07µs min=5.21µs  med=11.26µs max=468.17ms p(90)=33.42µs  p(95)=135.29µs p(99.9)=6.2ms   
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=78.38ms  min=4.92ms  med=76.18ms max=567.31ms p(90)=94.88ms  p(95)=102.68ms p(99.9)=325.74ms
     http_reqs......................: 38023   626.774781/s
     iteration_duration.............: avg=79.12ms  min=18.02ms med=76.64ms max=609.14ms p(90)=95.44ms  p(95)=103.22ms p(99.9)=360.39ms
     iterations.....................: 37923   625.126372/s
     success_rate...................: 100.00% ✓ 37923      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50

Performance Overview

HTTP Overview

Summary for: apollo-router

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 68421      ✗ 0    
     data_received..................: 2.0 GB  33 MB/s
     data_sent......................: 27 MB   438 kB/s
     http_req_blocked...............: avg=14.47µs  min=1.86µs  med=3.05µs   max=9.8ms    p(90)=4.4µs    p(95)=5.2µs    p(99.9)=5.32ms  
     http_req_connecting............: avg=10.78µs  min=0s      med=0s       max=9.77ms   p(90)=0s       p(95)=0s       p(99.9)=5.3ms   
     http_req_duration..............: avg=130.79ms min=6.11ms  med=129.77ms max=607.01ms p(90)=160.22ms p(95)=170.14ms p(99.9)=417.7ms 
       { expected_response:true }...: avg=130.79ms min=6.11ms  med=129.77ms max=607.01ms p(90)=160.22ms p(95)=170.14ms p(99.9)=417.7ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 22907
     http_req_receiving.............: avg=78.92µs  min=36.43µs med=54.26µs  max=6.22ms   p(90)=104.82µs p(95)=131.84µs p(99.9)=1.36ms  
     http_req_sending...............: avg=57.52µs  min=7.87µs  med=11.67µs  max=326.58ms p(90)=19.55µs  p(95)=36.46µs  p(99.9)=2.02ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=130.65ms min=6.05ms  med=129.68ms max=605.83ms p(90)=160.12ms p(95)=170ms    p(99.9)=415.67ms
     http_reqs......................: 22907   376.844495/s
     iteration_duration.............: avg=131.68ms min=19.4ms  med=130.14ms max=650.99ms p(90)=160.65ms p(95)=170.48ms p(99.9)=446.6ms 
     iterations.....................: 22807   375.199389/s
     success_rate...................: 100.00% ✓ 22807      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50

Performance Overview

HTTP Overview

Summary for: hive-gateway

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 55629      ✗ 0    
     data_received..................: 1.6 GB  27 MB/s
     data_sent......................: 22 MB   355 kB/s
     http_req_blocked...............: avg=17µs     min=1.28µs  med=2.78µs   max=9.87ms   p(90)=4.48µs   p(95)=5.65µs   p(99.9)=6.34ms  
     http_req_connecting............: avg=13.31µs  min=0s      med=0s       max=9.83ms   p(90)=0s       p(95)=0s       p(99.9)=6.32ms  
     http_req_duration..............: avg=160.74ms min=7.01ms  med=147.01ms max=697.12ms p(90)=183.53ms p(95)=290.6ms  p(99.9)=633.27ms
       { expected_response:true }...: avg=160.74ms min=7.01ms  med=147.01ms max=697.12ms p(90)=183.53ms p(95)=290.6ms  p(99.9)=633.27ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 18643
     http_req_receiving.............: avg=101.36µs min=26.04µs med=48.97µs  max=80.36ms  p(90)=113.65µs p(95)=188.01µs p(99.9)=4.32ms  
     http_req_sending...............: avg=100.92µs min=5.41µs  med=11.32µs  max=260.31ms p(90)=32.53µs  p(95)=124.82µs p(99.9)=4.88ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=160.53ms min=6.91ms  med=146.84ms max=695.94ms p(90)=183.2ms  p(95)=287.31ms p(99.9)=633.16ms
     http_reqs......................: 18643   305.163219/s
     iteration_duration.............: avg=162.01ms min=20.79ms med=147.4ms  max=739.98ms p(90)=184.04ms p(95)=312.16ms p(99.9)=635.06ms
     iterations.....................: 18543   303.52634/s
     success_rate...................: 100.00% ✓ 18543      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50

Performance Overview

HTTP Overview

Summary for: apollo-gateway

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 21804      ✗ 0   
     data_received..................: 647 MB  11 MB/s
     data_sent......................: 8.6 MB  140 kB/s
     http_req_blocked...............: avg=39.31µs  min=1.24µs  med=2.94µs   max=10.25ms  p(90)=4.38µs   p(95)=5.1µs    p(99.9)=8.86ms  
     http_req_connecting............: avg=35.97µs  min=0s      med=0s       max=10.21ms  p(90)=0s       p(95)=0s       p(99.9)=8.84ms  
     http_req_duration..............: avg=408.01ms min=7.38ms  med=407.57ms max=822.1ms  p(90)=462.99ms p(95)=481.2ms  p(99.9)=717.5ms 
       { expected_response:true }...: avg=408.01ms min=7.38ms  med=407.57ms max=822.1ms  p(90)=462.99ms p(95)=481.2ms  p(99.9)=717.5ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 7368
     http_req_receiving.............: avg=99.7µs   min=26.83µs med=51.42µs  max=145.81ms p(90)=91.7µs   p(95)=107.22µs p(99.9)=753.26µs
     http_req_sending...............: avg=107.48µs min=5.64µs  med=11.96µs  max=162.93ms p(90)=18.56µs  p(95)=23.35µs  p(99.9)=5.49ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=407.81ms min=7.33ms  med=407.47ms max=820.94ms p(90)=462.79ms p(95)=480.91ms p(99.9)=716.37ms
     http_reqs......................: 7368    120.468772/s
     iteration_duration.............: avg=414.01ms min=83.16ms med=408.3ms  max=847.99ms p(90)=463.87ms p(95)=481.86ms p(99.9)=813.5ms 
     iterations.....................: 7268    118.833745/s
     success_rate...................: 100.00% ✓ 7268       ✗ 0   
     vus............................: 39      min=39       max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

HTTP Overview

github-actions · 2025-10-26T19:03:15Z

Overview for: `ramping-vus`

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 60s

Comparison

Gateway	RPS ⬇️	Requests	Duration	Notes
hive-router	1767	110313 total, 0 failed	avg: 126ms, p95: 300ms	✅
grafbase	1455	92836 total, 0 failed	avg: 150ms, p95: 347ms	✅
cosmo	697	44422 total, 0 failed	avg: 316ms, p95: 734ms	✅
hive-gateway-router-runtime	612	40299 total, 0 failed	avg: 349ms, p95: 733ms	❌ non-compatible response structure (1)
apollo-router	394	26261 total, 0 failed	avg: 537ms, p95: 1224ms	❌ 20 unexpected GraphQL errors
hive-gateway	267	18410 total, 0 failed	avg: 761ms, p95: 1745ms	✅
apollo-gateway	133	9622 total, 0 failed	avg: 1327ms, p95: 2836ms	✅

Summary for: hive-router

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 327939      ✗ 0     
     data_received..................: 9.7 GB  155 MB/s
     data_sent......................: 128 MB  2.1 MB/s
     http_req_blocked...............: avg=524.14µs min=1.22µs  med=2.63µs   max=353.93ms p(90)=4.05µs   p(95)=4.8µs    p(99.9)=182.49ms
     http_req_connecting............: avg=520.56µs min=0s      med=0s       max=353.9ms  p(90)=0s       p(95)=0s       p(99.9)=182.38ms
     http_req_duration..............: avg=126.17ms min=1.75ms  med=114.52ms max=444.97ms p(90)=253.31ms p(95)=300.43ms p(99.9)=396.12ms
       { expected_response:true }...: avg=126.17ms min=1.75ms  med=114.52ms max=444.97ms p(90)=253.31ms p(95)=300.43ms p(99.9)=396.12ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 110313
     http_req_receiving.............: avg=553.86µs min=22.96µs med=42.86µs  max=136.39ms p(90)=140.67µs p(95)=402.02µs p(99.9)=74.95ms 
     http_req_sending...............: avg=465.95µs min=5.26µs  med=10.47µs  max=140.97ms p(90)=27.59µs  p(95)=130.76µs p(99.9)=72.48ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=125.15ms min=1.69ms  med=113.57ms max=414.8ms  p(90)=251.02ms p(95)=297.73ms p(99.9)=394.11ms
     http_reqs......................: 110313  1767.435646/s
     iteration_duration.............: avg=128.17ms min=1.92ms  med=116.11ms max=811.59ms p(90)=255.76ms p(95)=303.23ms p(99.9)=439.74ms
     iterations.....................: 109313  1751.413639/s
     success_rate...................: 100.00% ✓ 109313      ✗ 0     
     vus............................: 83      min=0         max=492 
     vus_max........................: 500     min=500       max=500

Performance Overview

HTTP Overview

Summary for: grafbase

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 275508      ✗ 0    
     data_received..................: 8.2 GB  128 MB/s
     data_sent......................: 108 MB  1.7 MB/s
     http_req_blocked...............: avg=757µs    min=1.27µs  med=3.09µs   max=472.89ms p(90)=4.55µs   p(95)=5.47µs   p(99.9)=235.09ms
     http_req_connecting............: avg=747.43µs min=0s      med=0s       max=415.44ms p(90)=0s       p(95)=0s       p(99.9)=234.95ms
     http_req_duration..............: avg=149.83ms min=2.91ms  med=138.15ms max=499.03ms p(90)=295.81ms p(95)=347.1ms  p(99.9)=435.52ms
       { expected_response:true }...: avg=149.83ms min=2.91ms  med=138.15ms max=499.03ms p(90)=295.81ms p(95)=347.1ms  p(99.9)=435.52ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 92836
     http_req_receiving.............: avg=681.07µs min=25.78µs med=48.91µs  max=178.73ms p(90)=107.66µs p(95)=456.43µs p(99.9)=96.58ms 
     http_req_sending...............: avg=620.57µs min=5.47µs  med=11.88µs  max=297.08ms p(90)=31.64µs  p(95)=145.65µs p(99.9)=91.01ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=148.53ms min=2.82ms  med=136.84ms max=452.14ms p(90)=293.2ms  p(95)=344.81ms p(99.9)=431.73ms
     http_reqs......................: 92836   1455.758932/s
     iteration_duration.............: avg=152.62ms min=3.25ms  med=140.29ms max=913.82ms p(90)=299.49ms p(95)=350.88ms p(99.9)=544.34ms
     iterations.....................: 91836   1440.077957/s
     success_rate...................: 100.00% ✓ 91836       ✗ 0    
     vus............................: 11      min=0         max=500
     vus_max........................: 500     min=500       max=500

Performance Overview

HTTP Overview

Summary for: cosmo

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 130266     ✗ 0    
     data_received..................: 3.9 GB  61 MB/s
     data_sent......................: 52 MB   812 kB/s
     http_req_blocked...............: avg=118.56µs min=1.21µs  med=2.71µs   max=198.83ms p(90)=4.02µs   p(95)=5.59µs   p(99.9)=40.32ms
     http_req_connecting............: avg=113.89µs min=0s      med=0s       max=198.79ms p(90)=0s       p(95)=0s       p(99.9)=40.26ms
     http_req_duration..............: avg=315.96ms min=2.8ms   med=288.72ms max=1.55s    p(90)=627.69ms p(95)=734.21ms p(99.9)=1.3s   
       { expected_response:true }...: avg=315.96ms min=2.8ms   med=288.72ms max=1.55s    p(90)=627.69ms p(95)=734.21ms p(99.9)=1.3s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 44422
     http_req_receiving.............: avg=525.92µs min=28.12µs med=57.13µs  max=132.7ms  p(90)=163.72µs p(95)=455.33µs p(99.9)=81.65ms
     http_req_sending...............: avg=175.64µs min=5.48µs  med=11µs     max=153.25ms p(90)=29.15µs  p(95)=125.58µs p(99.9)=36.73ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=315.26ms min=2.73ms  med=287.86ms max=1.55s    p(90)=626.77ms p(95)=732.78ms p(99.9)=1.3s   
     http_reqs......................: 44422   697.444884/s
     iteration_duration.............: avg=323.79ms min=3.01ms  med=296.73ms max=1.55s    p(90)=631.75ms p(95)=739.3ms  p(99.9)=1.3s   
     iterations.....................: 43422   681.744445/s
     success_rate...................: 100.00% ✓ 43422      ✗ 0    
     vus............................: 94      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

HTTP Overview

Summary for: hive-gateway-router-runtime

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✗ valid response structure
      ↳  99% — ✓ 39298 / ✗ 1

     checks.........................: 99.99% ✓ 117896     ✗ 1    
     data_received..................: 3.5 GB 54 MB/s
     data_sent......................: 47 MB  713 kB/s
     http_req_blocked...............: avg=161.03µs min=1.28µs  med=2.86µs   max=188.39ms p(90)=4.54µs   p(95)=6.4µs    p(99.9)=49.91ms 
     http_req_connecting............: avg=155.73µs min=0s      med=0s       max=188.32ms p(90)=0s       p(95)=0s       p(99.9)=49.82ms 
     http_req_duration..............: avg=348.55ms min=4.67ms  med=339.08ms max=1.15s    p(90)=664.03ms p(95)=732.81ms p(99.9)=924.99ms
       { expected_response:true }...: avg=348.55ms min=4.67ms  med=339.08ms max=1.15s    p(90)=664.03ms p(95)=732.81ms p(99.9)=924.99ms
     http_req_failed................: 0.00%  ✓ 0          ✗ 40299
     http_req_receiving.............: avg=210.01µs min=25.33µs med=45.1µs   max=136.46ms p(90)=95.54µs  p(95)=367.76µs p(99.9)=33.07ms 
     http_req_sending...............: avg=305.09µs min=5.65µs  med=11.07µs  max=179.11ms p(90)=30.19µs  p(95)=136.07µs p(99.9)=51.11ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=348.03ms min=4.63ms  med=338.67ms max=1.15s    p(90)=663.31ms p(95)=732.13ms p(99.9)=924.22ms
     http_reqs......................: 40299  612.50141/s
     iteration_duration.............: avg=358.02ms min=4.89ms  med=348.27ms max=1.18s    p(90)=667.82ms p(95)=736.28ms p(99.9)=940.66ms
     iterations.....................: 39299  597.302487/s
     success_rate...................: 99.99% ✓ 39298      ✗ 1    
     vus............................: 31     min=0        max=500
     vus_max........................: 500    min=500      max=500

Performance Overview

HTTP Overview

Summary for: apollo-router

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 25241 / ✗ 20
     ✓ valid response structure

     checks.........................: 99.97% ✓ 75763      ✗ 20   
     data_received..................: 2.3 GB 35 MB/s
     data_sent......................: 31 MB  460 kB/s
     http_req_blocked...............: avg=71.29µs  min=1.52µs  med=3.07µs   max=94.26ms p(90)=4.67µs  p(95)=6.14µs   p(99.9)=19.94ms
     http_req_connecting............: avg=66.53µs  min=0s      med=0s       max=94.22ms p(90)=0s      p(95)=0s       p(99.9)=19.64ms
     http_req_duration..............: avg=536.86ms min=5.71ms  med=495.88ms max=1.69s   p(90)=1.09s   p(95)=1.22s    p(99.9)=1.59s  
       { expected_response:true }...: avg=536.86ms min=5.71ms  med=495.88ms max=1.69s   p(90)=1.09s   p(95)=1.22s    p(99.9)=1.59s  
     http_req_failed................: 0.00%  ✓ 0          ✗ 26261
     http_req_receiving.............: avg=110.01µs min=30.36µs med=51.95µs  max=45.27ms p(90)=89.86µs p(95)=150.79µs p(99.9)=10.71ms
     http_req_sending...............: avg=103.24µs min=6.49µs  med=11.31µs  max=65.37ms p(90)=21.71µs p(95)=99.55µs  p(99.9)=20.21ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=536.64ms min=5.64ms  med=495.78ms max=1.69s   p(90)=1.09s   p(95)=1.22s    p(99.9)=1.59s  
     http_reqs......................: 26261  394.076738/s
     iteration_duration.............: avg=558.49ms min=5.95ms  med=521.94ms max=1.69s   p(90)=1.1s    p(95)=1.23s    p(99.9)=1.6s   
     iterations.....................: 25261  379.070579/s
     success_rate...................: 99.92% ✓ 25241      ✗ 20   
     vus............................: 91     min=0        max=499
     vus_max........................: 500    min=500      max=500

Performance Overview

HTTP Overview

Summary for: hive-gateway

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 52230      ✗ 0    
     data_received..................: 1.6 GB  24 MB/s
     data_sent......................: 22 MB   314 kB/s
     http_req_blocked...............: avg=162.73µs min=1.25µs  med=2.81µs   max=176.85ms p(90)=4.84µs  p(95)=8.12µs   p(99.9)=44.88ms
     http_req_connecting............: avg=157.13µs min=0s      med=0s       max=176.71ms p(90)=0s      p(95)=0s       p(99.9)=44.83ms
     http_req_duration..............: avg=760.54ms min=6.34ms  med=699.37ms max=5.12s    p(90)=1.5s    p(95)=1.74s    p(99.9)=3.97s  
       { expected_response:true }...: avg=760.54ms min=6.34ms  med=699.37ms max=5.12s    p(90)=1.5s    p(95)=1.74s    p(99.9)=3.97s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 18410
     http_req_receiving.............: avg=234.36µs min=25.81µs med=45.58µs  max=112.04ms p(90)=98.27µs p(95)=341.95µs p(99.9)=32.72ms
     http_req_sending...............: avg=230.58µs min=5.59µs  med=10.97µs  max=116.53ms p(90)=32.7µs  p(95)=126.92µs p(99.9)=39.09ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=760.07ms min=6.29ms  med=698.21ms max=5.12s    p(90)=1.5s    p(95)=1.74s    p(99.9)=3.97s  
     http_reqs......................: 18410   267.612427/s
     iteration_duration.............: avg=804.7ms  min=7.48ms  med=742.72ms max=5.13s    p(90)=1.52s   p(95)=1.75s    p(99.9)=4.09s  
     iterations.....................: 17410   253.076173/s
     success_rate...................: 100.00% ✓ 17410      ✗ 0    
     vus............................: 57      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

HTTP Overview

Summary for: apollo-gateway

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 25866      ✗ 0    
     data_received..................: 845 MB  12 MB/s
     data_sent......................: 12 MB   160 kB/s
     http_req_blocked...............: avg=45.79µs  min=1.31µs  med=4.26µs  max=41.25ms p(90)=6.96µs   p(95)=22.36µs  p(99.9)=8.35ms
     http_req_connecting............: avg=38.28µs  min=0s      med=0s      max=41.17ms p(90)=0s       p(95)=0s       p(99.9)=8.28ms
     http_req_duration..............: avg=1.32s    min=8.34ms  med=1.29s   max=17.45s  p(90)=2.34s    p(95)=2.83s    p(99.9)=16.57s
       { expected_response:true }...: avg=1.32s    min=8.34ms  med=1.29s   max=17.45s  p(90)=2.34s    p(95)=2.83s    p(99.9)=16.57s
     http_req_failed................: 0.00%   ✓ 0          ✗ 9622 
     http_req_receiving.............: avg=114.38µs min=29.84µs med=86.75µs max=21.89ms p(90)=140.86µs p(95)=176.88µs p(99.9)=3.22ms
     http_req_sending...............: avg=59.1µs   min=5.99µs  med=17.85µs max=24.07ms p(90)=39.52µs  p(95)=61.82µs  p(99.9)=7.93ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s      p(90)=0s       p(95)=0s       p(99.9)=0s    
     http_req_waiting...............: avg=1.32s    min=8.27ms  med=1.29s   max=17.45s  p(90)=2.34s    p(95)=2.83s    p(99.9)=16.57s
     http_reqs......................: 9622    133.224129/s
     iteration_duration.............: avg=1.48s    min=8.77ms  med=1.41s   max=17.46s  p(90)=2.39s    p(95)=2.87s    p(99.9)=16.66s
     iterations.....................: 8622    119.378345/s
     success_rate...................: 100.00% ✓ 8622       ✗ 0    
     vus............................: 89      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

HTTP Overview

# Conflicts: # gateways/hive-gateway-bun/package.json # gateways/hive-gateway/package.json # package-lock.json

# Conflicts: # gateways/hive-gateway-bun/package.json # gateways/hive-gateway/package.json # gateways/hive-router/install.sh # package-lock.json

enisdenjo added 3 commits October 26, 2025 19:44

bump grafbase and hive router

66c2b63

hive-router-query-planner gateway

7c0b77f

run

2c1d791

github-actions bot deployed to preview October 26, 2025 18:58 View deployment

bump in lockfile

5788311

github-actions bot deployed to preview October 26, 2025 19:04 View deployment

bump locfile

e8ac701

github-actions bot deployed to preview October 26, 2025 19:09 View deployment

This comment was marked as outdated.

Sign in to view

no jit

6710481

github-actions bot deployed to preview October 26, 2025 19:39 View deployment

enisdenjo added 2 commits November 5, 2025 17:00

Merge branch 'main' into hive-rtr-qp-in-hive-gw

3d4ad61

# Conflicts: # gateways/hive-gateway-bun/package.json # gateways/hive-gateway/package.json # package-lock.json

do config ts

12b8862

github-actions bot deployed to preview November 5, 2025 16:05 View deployment

enisdenjo added 7 commits November 11, 2025 15:50

Merge branch 'main' into hive-rtr-qp-in-hive-gw

7a047f8

# Conflicts: # gateways/hive-gateway-bun/package.json # gateways/hive-gateway/package.json # gateways/hive-router/install.sh # package-lock.json

bump stable

30f06ed

router runtimes

1bc8582

others and lock

5622f57

workflow

faeca1a

notify

18c84be

router runtime on others too

e39b15f

enisdenjo mentioned this pull request Nov 11, 2025

Update dependency @graphql-hive/gateway to v2.1.16 #862

Closed

1 task

enisdenjo added 2 commits November 11, 2025 16:22

fix lockfile

37d3be4

no bun

bd435ef

github-actions bot deployed to preview November 11, 2025 15:23 View deployment

no backtics

c41fe43

github-actions bot deployed to preview November 11, 2025 15:25 View deployment

enisdenjo added 2 commits November 11, 2025 16:27

no bun

4ce746d

no delays

74504aa

github-actions bot deployed to preview November 11, 2025 15:30 View deployment

print invalid once

2c43d8e

github-actions bot deployed to preview November 11, 2025 15:47 View deployment

enisdenjo added 2 commits November 11, 2025 16:50

event_name in fed-v1 group

b0e5ebb

revert printonce

8e9b349

github-actions bot deployed to preview November 11, 2025 15:56 View deployment

github-actions and others added 4 commits November 11, 2025 16:11

Update results for scenario: ramping-vus

238267e

Update results for scenario: constant-vus-over-time

4251ff3

no delay stuff

4352207

wait for hive gateway

863bc35

github-actions bot deployed to preview November 11, 2025 16:27 View deployment

github-actions and others added 3 commits November 11, 2025 16:34

Update results for scenario: constant-vus-over-time

e2b351c

Update results for scenario: ramping-vus

dde4457

wait for url also ramping

58fe3a4

github-actions bot deployed to preview November 11, 2025 16:44 View deployment

github-actions added 2 commits November 11, 2025 16:49

Update results for scenario: ramping-vus

1db236a

Update results for scenario: constant-vus-over-time

0c2481f

enisdenjo merged commit d1c21c1 into main Nov 11, 2025

enisdenjo deleted the hive-rtr-qp-in-hive-gw branch November 11, 2025 17:13

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Benchmark Hive Router Query Planner in Hive Gateway #841

Benchmark Hive Router Query Planner in Hive Gateway #841

Uh oh!

enisdenjo commented Oct 26, 2025 •

edited

Loading

Uh oh!

github-actions bot commented Oct 26, 2025 •

edited

Loading

Uh oh!

github-actions bot commented Oct 26, 2025 •

edited

Loading

Uh oh!

github-actions bot commented Oct 26, 2025 •

edited

Loading

Uh oh!

This comment was marked as outdated.

This comment was marked as outdated.

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Benchmark Hive Router Query Planner in Hive Gateway #841

Benchmark Hive Router Query Planner in Hive Gateway #841

Uh oh!

Conversation

enisdenjo commented Oct 26, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Oct 26, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

💻 Website Preview

Uh oh!

github-actions bot commented Oct 26, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Overview for: constant-vus-over-time

Comparison

Uh oh!

github-actions bot commented Oct 26, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Overview for: ramping-vus

Comparison

Uh oh!

This comment was marked as outdated.

This comment was marked as outdated.

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

enisdenjo commented Oct 26, 2025 •

edited

Loading

github-actions bot commented Oct 26, 2025 •

edited

Loading

github-actions bot commented Oct 26, 2025 •

edited

Loading

Overview for: `constant-vus-over-time`

github-actions bot commented Oct 26, 2025 •

edited

Loading

Overview for: `ramping-vus`